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1.0  IMTPOn'JCTION 

N 

V.'or'<  on  this  project  since  the  appearance  of  the  October  Interim 
Report  [1]  has  focused  on  three  problems  implicitly  raised  in  that 
report: 

To  crovide  the  basis  for  an  HOS  specification  of  the  OVS 
system  in  terns  of  which  the  further  development  of  the 
system  might  be  expressed. 

(2)  To  determine  the  extent  to  v/hich  a  square  areal  coordinate 
system  can  really  be  used  as  a  basis  for  image 
understanding. 

(3)  '..'hat  formal  frameworks  for  knowledge  representation  might 
lend  themselves  to  being  useful  in  dealing  with  the  various 
s'jblcasses  of  image-derived  information  that  are  relevant  to 
the  TVS  system? 

In  this  reoort  we  review  this  work  in  terms  of  both  the  results 
achieved  and  the  further  problems  arising  from  it. 
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THE  HOSIFICATION  OF  OVS 


2.0 


OVS  IS  a  knowledge-representation  system  for  information  derived 
fro'm  visual  images,  such  as  radars,  and  other  sources,  with  the  intent 
of  identifying  and  classifying  the  real-world  objects  that  serve  as 
the  basis  for  those  images.  The  system  is  made  up  of  a  set  of 
experts ,  v.riich  serve  as  the  information  sources,  and  which  issue 
reports ,  consisting  of  information  being  reported  to  the_data  base 
concerning  observed,  but  as  yet  not  necessarily  identified  objects. 
Such  information  can  be  of  any  one  of  three  distinct  modes  (called 
"modules"  in  the  earlier  report,  but  "modes"  is  a  less  confusing  term) 

(1)  The  descriptive  mode:  information  is  stored  in  the  form  of 
attribute-value  associations;  ca'n  be  summaraized  by  the 
code-term  "has-a",  indicating  that  a  given  reported  object 
"has  a  "  specific  attribute. 

(2)  The  cateqorv  mode:  information  is  stored  in  the  form  of 
lists;  can  be  summarized  by  the  code-term  "is-a",  indicating 
tnat  a  given  reported  object  "is  a"  member  of  a  specific 
category  of  possible  objects. 

(3)  The  functional  mode:  information  is  a  again  stored  in  the 
form  of  lists;  can  be  summarized  by  the  code-term 
"used-for",  indicating  that  a  given  reported  object  is  "used 
for"  the  carrying  out  of  a  given  function. 

The  data  base  itself  consists  of  the  sum-total  of  all  reported 
information,  v/r.ich  thus  constitutes  the  knowledge  represented  and 
stored  in  the  OVS  system. 

The  full  OVS  system  would  require  more  filling  out^trf  the  details 
invol/ed  in  it,  but  this  gives  us  its  basic  underlying  components.  We 


3 


PRECEDING  PAGE  BLANK 


thus  end  up  with  five  essential  data  types,  in  terms  of  which  the 
workings  of  the  system  must  be  expressed: 

(1)  experts :  whatever  it  is  that  reports  information  to  the 
data  base; 

(2)  modes :  any  one  of  three  kinds  of  information  that  an  expert 
can  report  to  the  data  base; 

(3)  information:  \vhatever  it  is  that  an  expert  reports  to  the 
data  base; 

(4)  knowledge:  the  data  base  itself; 

reports :  whatever  form  it  is  in  which  information  gets 
reported  by  the  experts  to  the  data  base. 

Constructing  HOS  specifications  for  the  data  types  in  such  a  list 
involves  sorting  out  the  interrelationships  among  the  data  types  them¬ 
selves  and  the  essential  properties  and  interactions  of  the  members  of 
each  data  type.  These  properties  are  expressed  in  terms  of  primitive 
operations  that  map  into  and  out  of  the  respective  data  types  in 
accordance  with  axioms  that  serve  as  constraints  on  their  ultimate 
implementational  behavior.  The  actual  method  of  constructing  such  a 
specification  involves  a  process  of  successive  approximation,  in  which 
primitive  operations  are  determined  to  be  needed  to  express  the 
desired  properties  and  axioms  are  formulated  to  express  them  in  terms 
of  these  primitive  operations.  Initial  formulations  generally  reveal 
simplifications  that  could  be  achieved  by  replacing  a  primitive  opera¬ 
tions  on  one  data  type  with  an  equivalent  one  on  some  other  data  types 
or  with  an  HOS  operation  or  structure  that  removes  the  purported  pri¬ 
mitive  operation  from  the  data  type  specification  altogether,  except 
perhaps  that  reference  might  still  be  made  to  it  in  an  axiom,  even 


DATA  TYPE:  EXPERT; 


PRIMOPS:  ; 
AXIOMS:  ; 
END  EXPERT; 


Figure  1:  Data  Type 
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EXPERT 


though  it  is  not  included  in  the  primitive  operation  list  for  that 
data  type.  In  the  present  report  \-/e  give  only  the  final  results  of 
this  process,  in  which  the  simplest  and  most  concise  formulation  of 
the  data  types  involved  has  been  achieved;  we  will  mention,  in 
passing,  however,  alternate  choices  that  might  occur  to  a  specifier 
and  that  did  play  a  role  in  earlier  approximat ions ,  but  whose  removal 
or  reformulation  led  to  a  simplification  of  the  specification. 

2.1  Data  Type  EXPERT 

It  might  appear,  at  first  glance,  that  KNOWLEDGE  should  be 
the  data  type  with  which  we  begin  our  specification,  since  this  is 
what  we  are  building  with  OVS  through  storing  the  information 
contained  in  reports,  but  this  turns  out  to  be  a  mistake,  because 
KNOWLEDGE  can  be  characterized  only  in  terms  of  its  interaction  with 
information,  which  must  therefore  have  been  specified  already.  REPORT, 
similarly,  requires  reference  to  information  and  experts,  while 
INFORMATION  icself  has  modes  as  an  essential  property.  Upon  reflec¬ 
tion  and  analysis,  we  realize  that,  while  other  data  types,  except 
MODE,  require  ultimate  reference  to  experts  in  their  specification, 
experts  themselves  can  be  anything  at  all  that  can  issue  reoorts  con¬ 
taining  information,  and  this  latter  characteristic  is  most  naturally 
included  in  the  specifications  of  these  other  data  types,  rather  than 
in  EXPERT  itself.  It  follows  that  we  can  view  an  expert  as  anything 
at  all  and  thus  provide  it  with  an  HOS  specification  with  no  primitive 
operations  or  axioms,  as  shown  in  Figure  1. 

2.2  Data  Type  MODE 

’•'odes  are  simply  the  different  kinds  of  information  that  get 
resorted  by  experts  to  the  data  base,  and  it  does  not  matter  at  this 
layer  of  specification,  what  other  properties  they  may  have.  We  have 
noted,  for  example,  that  descriptive-mode  information  is  most 
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naturally  stored  in  the  form  of  attribute-val ue  associations,  while 
category-mode  and  funct ional -mode  information  is  most  naturally  stored 
in  the  form  o‘  lists,  but  how  information  is  stored  is  entirely  a 
matter  of  implementation,  not  an  essential  characteristic  of  the 
reported  information  itself.  It  follows,  therefore,  that  our  HOS  spe¬ 
cification  of  data  type  MODE  need  only  capture  the  fact  that  three  and 
only  three  modes  of  information  exist  in  OVS,  as  expressed  in  the 
specification  in  Figure  2.  MODE  has  no  primitive  operations  of  its 
own,  because  she  only  thing  that  we  do  with  modes  is  associate  them 
with  information  in  reports,  and  this  latter  characteristic  is  most 
naturally  expressed  as  part  of  the  specification  of  one  of  these 
latter  two  data  types,  once  MODE  itself  has  already  been  made 
available.  S'nce  the  only  characteristic  of  modes  that  we  have  to 
express  is  that  there  are  exactly  three  distinct  ones,  the  only  primi¬ 
tive  cperatiors  we  have  to  use  are  boolean  ones,  including  equality. 
The  first  WHERE  statement  in  Figure  2,  therefore,  names  the  three 
distinct  modes,  -while  the  axioms  guarantee  that  the  three  named  modes 
are  d-'stinct.  The  first  axiom  says  that,  given  any  mode  at  all,  that 
mode  is  (equal  to /  one  of  the  three  named  modes.  This  tells  us  that 
there  are,  in  -^act,  (at  most)  three  modes.  The  other  three  axioms 
then  guarantee  that  no  two  nodes  are  the  same. 

2.3  Data  Type  INFORMATION 

The  only  significant  contraints  that  we  want  to  put  on 
information  are  that  it  constitutes  the  content  of  a  report  and  it 
comes  in  three  modes.  The  former  fact  is  most  naturally  (simply, 
perspicuously,  and  so  on)  stated  <•$  part  of  the  specification  of  data 
type  REPORT,  once  INFORMATION  is  already  available,  and  the  latter  can 
be  stated  simcly  by  giving  INFORMATION  a  primitive  operation  that 
assigns  every  (piece  of)  information  a  mode,  as  shown  in  Figure  3.  We 
do  not  require  any  axioms  cn  this  primitive  operation,  because  what 
those  axioms  would  say  is  already  included  in  the  specification  of 
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DATA  TYPE;  MODE; 

PR I MOPS:  ; 

AXIOMS:  ; 

'^ERE  Isa,  Has,  Usedfor  ARE  CONSTANT  .MODES; 

V/HERE  n  is  a  MODE; 

Or(Equal  (m, Isa) .Equal (m.Hasa), Equal (m, Usedfor))  =  True; 
Equal ( I sa ,Hasa)  =  False; 

Equal (Isa, Usedfor)  *  False; 

Equal (Hasa, Usedfor)  =  False; 

END  MODE; 

Figure  2:  Data  Type  MODE 


DATA  TYPE:  INFORMATION; 

PRIMOPS:  mode  =  Mode(information) ; 
AXIOMS:  ; 

END  INFORMATION; 

Figure  3:  Data  Type  INFORMATION 
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data  type  The  fact  that  there  are  exactly  three  kinds  of  infor- 

nation  an  expert  can  report  is  automatically  accounted  for  by  simply 
providing  every  information  with  a  mode,  because  the  axioms  of 
Figure  2  already  tell  us  that  there  are  exactly  three  of  these. 

2 . 4  2ata  "^ype 

Data  type  KNOWLEDGE  is  significantly  more  complex  than  the 
three  others  have  discussed  so  far,  because  its  simplest  for¬ 
mulation  involves  the  use  of  a  non-or imitive  operation,  as  well  as 
primitive  o'erations  and  axioms.  KNOWLEDGE  is  the  data  base  to  which 
experts  ret:’'t  information.  Each  such  report  updates  the  data  base  by 
adding  to  it  the  content  of  the  report,  thereby  changing  the  state  of 
the  data  base.  The  members  of  data  type  KNOWLEDGE  are  thus  the  states 
of  the  data  base,  which  v;e  can  also  refer  to  as  states  of  knowledge. 

We  can  account  for  updating  by  providing  KNOWLEDGE  with  a  primitive 
operation  t^at  inputs  a  (state  of)  knowledge  and  the  content  of  a 
retort  and  t"at  outputs  another  (state  of)  knowledge,  but  the  specifi¬ 
cation  is  s'mt''ified  by  having  this  primitive  operation  input  a 
knowledge  a^d  an  information,  as  shown  in  Figure  4,  leaving  the  con¬ 
tents  of  reports  for  data  type  ^EDOTT.  The  axiom  in  this  specifica¬ 
tion  says  that,  if  we  update  a  state  of  knowledge  by  a  piece  of 
information,  then  that  piece  of  information  is  in  the  resulting  state 
of  knowledge,  clearly  an  essential  property  of  an  update  operation. 

The  Isin  operation,  itself,  however,  remains  to  be  characterized,  and 
this  could  be  done  by  making  it  a  primitive  operation  with  further 
axioms,  but  it  is  simpler  to  make  it  a  non-primitive  operation  defined 
in  terms  of  L'cdate,  as  shown  in  Figure  5.  What  this  operation  speci¬ 
fication  tells  us  is  that  a  piece  o^  information  is  in  the  data  base, 
if  adding  it  to  the  data  base  would  not  change  the  data  base,  i.e.,  if 
adding  it  to  tne  present  state  of  knowledge  leaves  the  state 
unchanged.  It  would  be  possible  to  write  the  equivalent  of  Figure  5 
as  an  axio",  but  this  v/ould  mask  its  non-primitive  character,  primiti- 
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DATA  TYPE:  KNOWLEDGE; 

PRIMOPS:  knowledge2  =  Update(know1edgei , information) ; 
AXIOMS: 

WHERE  in  IS  AN  INFORMATION; 

WHERE  kn  IS  A  KNOWLEDGE; 

Isin(in,Update(kn,in))  =  True; 

END  KNOWLEDGE; 


Figure  4:  Data  Type  KNOWLEDGE 


OPERATION:  b  =  Isin(in,kn); 

WHERE  b  IS  A  BOOLEAN; 

WHERE  in  IS  AN  INFORMATION; 

WHERE  kn,  kn'  ARE  KNOWLEDGES; 

b  =  Equal (kn' ,kn)  COJOIN  kn'  =  Update(kn ,i n) ; 
END  Isin; 
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vity  being  de^i^ed  as  ''cn-deco"'rosabil  ity  in  terms  of  an  HOS  control 
map.  Taken  together.  Figures  4  and  5  characterize  both  Update  and 
Isin  anc,  thereby,  data  tyoe  KNOWLEDGE. 

2.E  Data  '''yoe  REPORT 

"^he  sreci f icat ion  of  data  type  REPORT  is  the  most  complex  of 
all,  containing  a  nunbe*’  of  properties  that  might  otherwise  thought  to 
be  necessary  in  the  specifications  of  some  other  data  type.  A  report 
consists,  i'i  essence,  c‘  an  author  and  a  content,  the  author  being 
seme  expert  and  the  cc'',tent  being  some  bit  of  information,  in  one  of 
the  t’”ree  ■msies.  '■<'e  ceJd  have  tried  to  include  this  fact  in  the  spe¬ 
cifications  0^  expert  c  in'^cr-ation,  but  this  becomes  unnecessary,  if 
we  say  it  c^ce  and  for  all  in  the  speci f icat ion  of  reports.  In 
effect,  the  other  data  tyo«  specifications  a-'e  "incomplete"  rel ati ve 
to  the  ■'ul  1  CVS  system,  because  facts  about  their  data  types  remain 
unstated,  '.•,'hen  those  sceci f ications  are  taken  by  themselves,  but  the 
specification  fi'is  in  the  missing  facts,  so  that  the  sceci- 

fication  of  OVS  as  a  whole  is  complete.  The  relation  between  experts, 
information,  and  reports  can  be  formulated,  for  example,  in  terms  of  a 
primitive  operation  that  assigns  every  report  an  expert,  its  author, 
and  an  -information,  its  content,  plus  an  axiom  that  says  that  equality 
of  reports  amounts  to  ecuality  of  both  authors  and  contents,  as  shown 
in  Figure  5.  ""he  third  primitive  operation  in  Figure  6,  Before, 
turns  out  not  to  be  needed  in  any  axiom  on  REPORT,  but  it  is  needed  to 
formulate  a  non-primitive  operation.  After,  that  does  appear  in  such 
an  axiom!.  Before  is  a  primitive  operation  that  assigns  to  a  report 
the  state  of  the  data  base  --  i.e.,  the  state  of  knowledge  --  that 

existed  before  the  repo’^t  was  made,  and  After  is  an  operation  that 

assigns  to  a  ’'eport  the  state  c-f  knowledge  that  exists  after  the 
report  is  made.  The  relation  between  Before  and  After  is  stated  in 

Figure  7,  which  says  that  the  state  of  knowledge  after  a  report  is 

obtained  by  tak-'ng  the  state  of  knowledge  before  the  report  and 
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DATA  TV PE;  REPORT; 

PRIMOPS:  exoert  =  Author( report ) ; 


infomation  =  Content  (report); 
knowledge  =  Bef ore (report); 

AXIOMS; 

WHERE  ri,  r2,  r  ARE  REPORTS; 

Equal !r|,r2)  =  And(Equal (Author(ri) ,  Author( r2) .Equal (Content (rj ) .Content (r2) )) ; 

t 

Isi n(Content ( r) ,After( r) )  *  True; 

E’o  ^E^ORT; 


'figure  6;  Data  Type  -REPORT 


^.^E  =  ATI0N;  kn  =  A^ter(r); 

',;-:ERE  kn.kn'  APE  <N0', .’LEDGES; 

WHEPE  in  IS  AN  INFORMATION; 

'WHERE  r  IS  A  REPORT; 

After;  kn  =  Update(kn' ,i n)  JOIN  (kn'.in)  =  f(r); 
f;  kn'  =  Before(r)  COINCLUDE  in  =  Content(r); 

END  After; 


Figure  7;  Operation  After 
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updating  it  by  the  contents  of  the  report.  Given  this  charac¬ 
terization  of  After,  the  second  axiom  in  Figure  6  tells  us  that  the 
content  of  a  report  is  in  the  state  of  knowledge  that  exists  after  the 
report  is  made,  thereby  relating  Content  and  After  to  I  sin,  and  infor¬ 
mation  and  reports  to  knowledge. 

2.6  Further  Specification  Constraints  Derivable  for  the  Data 
Tvoes 


Given  these  data  type  specifications,  many  other  facts  that 
we  would  like  to  be  true  of  the  specified  data  types  can  be  proven  as 
theorems,  and,  therefore,  do  not  have  to  be  included  among  the  axioms  of 
one  or  another  of  the  data  types.  This  significantly  simplifies  the 
specifications  themselves  and  argues  for  maximal  care  in  choosing  and 
formulating  orimitive  operations  and  their  associated  axioms.  For 
example,  we  would  like  to  be  able  to  be  sure  that  the  content  of  a 
report  does  not  change  the  state  of  the  data  base  if  the  information 
it  contains  ^s  already  in  the  data  base  to  begin  with,  i.e.,  if  the 
report  itself  is  redundant,  and,  in  fact,  we  can  get  this  result 
straightforwardly  -^rom  the  axioms  we  already  have: 

THEOREM:  Isi n(Content  (r )  ,Befo''e(r ) )  =  Equal  (After(r)  ,Before(r) ) 


Proof: 

From  the  definition  of  Isin  (Figure  5), 
Isin(in,kn)  =  Equal  ('Jpdate(kn, in)  ,kn). 
Let  in  =  Content(r) 
kn  =  8efore(r) ,  so 
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Isin(Content(r)  ,Before(r ) )  =  Equal  (Update'(3efore(r)  .Content  (r) )  ,Before(r ) ) ) . 


Fron  the  definition  of  After  (Figure  7), 

Upclate(3efore(r)  ,Content(r))  =After(r),  so 
Isin(Content(r) ,Before(r))  =  Equal (After (r) ,Before(r) ) 

Q.E.D. 

In  other  words,  the  contents  of  a  report  is  in  the  data  base,  if  and 
only  if  the  state  of  the  data  base  is  the  same  after  the  report  would 
be  made  as  it  is  before  the  recort  is  made,  i.e.,  reporting  infor¬ 
mation  that  is  already  in  the  data  base  leaves  the  state  of  the  data 
base  unchanged.  Other  essential  characteristics  that  we  would  want 
our  data  types  to  have  can  also  be  proven  as  theorems  in  a  similar 
way,  so  v.'S  can  conclude  that  our  characterization  of  them  is 
compl ?te. 


2.7  Prospectus 


We  thus  have  complete  characterizations  of  the  basic  data 
types  that  'we  need  for  our  specification  of  the  OVS  knowledge- 
representat  ion  system.  Further  work  on  the  HOSification  of  OVS  would 
involve  the  construction  of  a  control  map  that  would  capture  the 
actual  workings  of  the  system,  i.e.,  the  full  dynamics  through  which 
the  members  of  the  data  types  interact.  The  construction  of  such  a 
control  map  would  undoubtedly  reveal  further  data  types,  operations, 
and  structures  that  would  have  to  be  specified  as  well,  and  this  would 
const'tute  a  part  of  the  process  of  constructing  the  control  map 
itself,  "re  final  result  would  be  a  control  map  representing  the 
dyna-mc  architecture  of  the  OVS  system  and  a  set  of  data  type, 
operation,  a-d  structure  specifications  used  within  the  control  map. 
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The  latter  items  could  then  be  added  to  the  developing  HOS  library  for 
inclusion  in  other  systems,  as  the  need  for  them  arises. 
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3.0  AREAL  COORDINATE  SYSTEMS 


IiTiplicit  in  the  earlier  report  [1]  were  a  number  of  results  con¬ 
cerning  the  generality  of  the  numerical  encodings  proposed  for  each  of 
the  illustrated  coordinate  systems.  Zero-  and  first-level  aggregates 
were  shown  (based  on  [2])  in  the  hexagon  system  to  obey  addition 
tables  in  which  base  digits  add  modulo  7,  while  the  square  system  with 
square  first-level  aggregates  were  shown  to  have  no  suitable  addition 
table.  Furthermore,  square  systems  with  null  or  uniform  displacement 
were  shown  to  satisfy  addition  tables  in  which  base  digits  add  modulo 
5  in  the  case  in  v.hich  aggregates  and  coding  digits  "climb"  in  oppo¬ 
site  directions  and  to  have  no  suitable  addition  tables  in  the  case  in 
which  these  "climb"  in  the  same  direction.  Work  in  this  area  since 
that  report  has  concentrated  almost  entirely  on  trying  to  generalize 
these  results  beyond  the  first  level,  to  second-level  aggregates  and 
beyond. 

Initial  work  in  this  area  focused  on  trying  to  formulate  and 
prove  a  theorem  to  the  effect  that  the  given  coordinate  systems  and 
their  numerical  encodings  are  completely  general.  First-level 
arithmetic  is  general,  in  those  systems  in  which  tables  exist  at  all, 
and  an  attempt  was  made  to  extract  an  underlying  principle  from  the 
resoective  tables  which  could  be  extended  to  higher-level  aggregates. 
All  efforts  in  this  direction  proved  futile  and  attention  was  then 
turned  to  a  direct  examination  of  higher-level  arithmetic  in  order  to 
see  whether  such  a  principle  could  be  derived  from  the  higher  levels, 
because  of  the  greater  perspective  they  might  provide  on  the  problem 
of  numerical  encoding  as  a  whole.  This  examination  led  to  the  disco¬ 
very  that  a  principle  of  the  desired  generality  could  not  exist, 
because  there  are  counterexamples  to  the  claim  it  would  make  on  the 
second  level  of  aggregates. 

The  kind  of  problem  encountered  in  this  work  is  illustrated  in 
Figure  8.  In  this  figure  are  given  the  zero  through  third  level  of 
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aggregates  for  a  square  system  with  null  displacement  in  which  first- 
level  aggregates  climb  downward  and  coding  digits  climb  oppositely. 

As  we  saw  in  the  earlier  report,  such  a  coordinate  system  should  have 
a  completely  regular  first-level  addition  table  in  which  base  digits 
add  modulo  5,  and,  in  fact,  it  does,  as  shown  in  Figure  9.  Given  the 
first-level  addition  table,  the  encodings  of  the  second  level  are 
forced,  and  those  of  the  third-level  can  presumably  be  derived  from 
them.  Perhaps  supri singly,  the  requirements  of  the  addition  force  the 
20  and  30  first-level  aggregates  to  be  reversed  from  the  positions 
they  would  be  in  if  their  placement  followed  that  of  the  zero-level 
aggregates,  as  is  the  case  in  the  hexagon  system.  With  this 
modification,  however,  first-level  addition  works  perfectly,  in  accor¬ 
dance  with  Figure  9,  as  shown  for  some  examples  in  Figure  10. 

For  example,  the  addition  table  (plus  associativity)  tells  us 
that  21  +  21  =  2412,  and  this  is  exactly  what  we  find  to  be  the  case 
when  v.'e  check  the  locations  21  and  2412  in  Figure  8.  Similarly,  the 
table  tells  us  that  22  +  43  =  310,  and  this,  too,  is  verified  by 
checking  with  Figure  8.  Again,  according  to  the  table,  43  +  34  = 

4212,  and  this  is  confirmed  by  a  check  with  Figure  8. 

On  the  second  level  of  aggregates,  the  addition  also  works  for 
most  examples,  as  illustrated  in  Figure  11.  Adding  100  and  300  gives 
us  2400,  according  to  the  table,  and  also  according  to  Figure  8.  The 
table  tells  us  that  142  +  331  =  2433,  and  this  is  confirmed  by  a  look 
at  -igure  8.  If  we  try  enough  examples  on  this  level,  however,  we 
eventually  discover  that  there  are  also  some  that  do  not  work,  as 
illustrated  in  Figure  12.  According  to  the  table,  for  example,  100 
plus  100  should  be  2200,  but  Figure  8  puts  100  +  100  in  the  1000 
agc'-egate,  rather  than  the  2000  aggregate,  which  we  know  to  be 
somewhere  else  because  of  the  21  +  21  example  in  Figure  10. 

Such  counterexamples  to  the  addition  table  are  the  exception  on 
this  level,  not  the  rule,  but  the  fact  that  they  exist  at  all  creates 
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Figure  10;  Examples  of  Addition  on  Level  1 
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(a) 


100 

100 

100 

700 

300 

300 

300 

m 

0 

00 

2400 

:  100  +  300  =  2400 

(b) 


0 

0 

0 

1 

7 

7 

7 

142 

142 

142 

142 

740 

331 

337 

337 

337 

337 

3 

3 

33 

2433 

:  142  +  331  =  2433 

Figure  11:  Exa~.Dies  of  Addition  on  Level  2 


100 

100 

100 

700 

100 

100 

100 

M 

0 

00 

2200 

100  +  100  I  2200 


Figure  12:  A  Counterexai-ple  to  Addition  on  Level  2 
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problen^s  for  the  attempt  to  generalize  the  numerical  encoding  of 
square  coordinate  systems.  Square  systems  are  superior  to  hexagon 
systems  in  the  ways  stated  in  the  earlier  report,  but  hexagon  systems 
are  superior  in  the  ease  with  which  their  numerical  encodings  and 
arithmetic  on  level  zero  can  be  generalized  to  higher  levels.  Square 
systems  could  still  be  made  useful  for  plane  decomposition  for  image 
processing  through  the  introduction  of  ad  hoc  techniques  to  get  around 
the  exceptions,  but  the  optimal  solution  would  be  to  figure  out  what 
the  principle  is  that  makes  the  arithmetic  work  in  those  cases  in 
v/hich  it  does.  Future  research  should  involve  further  attempts  to 
determine  this  principle  and  develop  its  implications  for  practical 
use. 
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4.0  CANDIPAT;  FORV-AL  FRA‘-*El-.'ORKS  FOP.  KNOWLEDGE  REPRESENTATION 

4.1  I  r.troducti  on 

I-aoine  a  robot  that  has  been  instructed  to  collect  samples 
of  all  the  physical  objects  he  perceives.  This  visual  device  tells 
him  v.'hich  a-'e  the  physical  objects  v/hat  is  their  size  and  shape, 
texture,  etc.  Once  he  identifies  a  physical  object,  if  it  is  small  he 
collects  it  'grasps)  ar.d  outs  't  inco  a  bag.  If  the  object  is  big, 
then  he  takes  a  sample  of  it.  If  there  are  any  objects  that  might 
break,  they  should  be  carried.  Otherwise,  for  efficiency,  he  can  just 
threw  them  'n  the  bag. 

i.-other  robot  examines  the  objects  collected  in  the  bag  and 
classifies  tnem  by  othe'"  qualities  than  size.  Me  throv/s  away  those 
which  are  not  relevant,  O'-  those  about  which  the  robot  is  instructed 
that  they  are  uninteresting  because  copies  of  them  already  exist.  He 
puts  the  'rag-le  objects  seoarately. 

'..'hat  do  these  tasks  reo'ji’'e?  They  require  the  ability  to 
perceive  and  visually  represent  o'njects  from  the  environment.  Is  pure 
visual  '-epresentation  enough?  '-cv/  does  he  "put"  the  object  in  the  bag 
situated  at  some  distance?  Th'is  is  to  ask,  how  can  he  "distance"  the 
objects  to  a  new  location?  In  deciding  v/hat  to  do  to  an  object,  in 
order  to  choose  its  location,  the  robot  has  to  know  in  which  actions 
(throwing,  carrying)  he  can  involve  the  object.  More  than  that,  if 
the  object  is  too  big  to  displace  it  unsustained,  then  he  should  cut  a 
piece  of  'it.  Let  us  suooose  that  under  a  big  rock  something  is 
shining,  "^us,  the  robot  v/hose  view  v/as  captured  by  the  shine,  wants 
to  identify  a-'d  take  a  sa~ole  c'  that  object.  The  rock  on  top  of  it 
is  too  big  though,  he  cannot  graso  it,  then  he  decides  to  push  it. 

And  here  is  the  shining  little  object,  thin,  and  very  structured. 

Thus,  S''''ce  throwing  it  “ight  b-^eak  this  the  robot  carries  it  to  the 
bag. 
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It  would  be  very  useful  for  the  robot  to  know  how  to  repre¬ 
sent  knowledge  about  these  objects  in  the  world  in  relation  to  the 
action  that  can  be  done  uoon  then  safely.  This  requires  more  than 
just  30  and  2^/50  representation;  it  requires  an  action-based  represen 
tation  of  the  kind  we  are  proposing.  But  more  than  that,  from  this 
simple  example,  we  infer  too  that  this  action-based  representation 
constitutes  the  basis  for  higher-level  tasks,  such  as  resolving  and 
planning,  and  even  knowledge  and  belief. 

4.2  Knowledge  Representation 

Representat ion  theory  deals  with  what  information  we  need 
and  how  it  is  reoresented  in  the  computer.  Heuristics  is  concerned 
with  the  structure  of  the  problem-solving  ‘algorithms. 

The  main  problem  of  A1  is  to  find  a  good  answer  to  the 
Question  how  a  computer  can  acquire,  represent,  modify,  and  make  use 
of  knowledge  of  the  world.  In  this  report  we  review  some  formal  fra¬ 
meworks  that  show  promise  for  being  useful  in  representing  the 
knowledge  acquired  from,  vision.  The  problems  of  how  this  knowledge 
can  be  acquired,  modified,  and  made  use  of  should  be  the  topics  of 
further  research. 

4.3  Inference  Mechanisms 


The  user  provides  a  scalar  measure  of  his  reliance  on  each 
rule,  interpreted  as  the  truth  value  of  the  implication  underlying  the 
rule.  The  rule  to  fire  is  chosen  among  the  set  of  rules 


Ri,  ^ 

by  taking  into  account  the  qualities  of  the  triggers 
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qi,  i  =  l,in 


and  the  truth  values 


t^^  1  ""  Ijin* 

The  choice  between  and  Rf  is  not  straightforward  when  q-j  >  qj  and 
t-j  <  tj.  Then  a  heuristic  is  needed  to  select  the  rule  to  fire. 
Roughly  speaking  q^  is  the  adequation  of  the  rule  R-j  to  the  current 
state  of  the  data  basis.  So,  that  t^'s  can  be  used  to  discriminate 
between  the  preselected  rules. 

Inexact  Reasoning 


Once  a  rule  is  ■'ixed,  its  consequences  have  to  be  recorded 
in  the  data  base.  Symbolically  a  rule  is  of  the  form  p-j — ►  C-j  where 
Pt  is  the  instantiated  trigger  and  C-j  the  instantiated  consequence. 

Two  situations  are  possible:  z-values  different  from  1  are 
allowed  or  not  to  qual'^y  the  atoms. 

'1)  Let  Zi  be  the  z-value  of  the  instantiated  trigger 
Pi  (i.e.,  the  concatenation  o^  the  selected  data);  z^  is  calculated 
through  a  conjunction  operator  (e.g.,  min)  from  the  z-values  of  the 
atoms  which  are  Pi .  Two  points  of  view  are  possible  for  the  eva¬ 
luation  of  the  truth- value  of  the  premise  p-j  of  the  rule  to  fire  ; 
Pi  is  equal  to  Zi  or  Pi  is  equal  to  the  conjunctive  aggregation  of 
Zi  and  Pi  (min(zi,qi)  ^i’9i)  ^  account  the 

fact  that  generally  the  selected  data  do  not  perfectly  match  the 
premi ses. 


From  Di  and  the  truth-value  ti  of  the  rule,  by  means  of  a 
detatch"'ent  operator  *  'linked  to  the  multivalent  implication 
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implicitly  chosen  to  make  p-j  — *-0^ )  a  lower  bound  *  t^  of  the 
truth-value  Cj  of  the  consequence  C,-  is  computed.  All  the  instan¬ 
tiated  atoms,  present  in  the  new  data  built  from  the  consequence, 
receive  C-j  as  a  z-value. 

2)  Without  z- values 

If  there  is  no  explicit  z-value  in  the  system  it  means 
Zi  =  1;  then  the  computed  c-j,  which  is  not  necessarily  1,  is  used  to 
validate  or  invalidate  the  selection  and  the  consequences  of  the  rule 
under  consideration.  If  no  rule  in  the  preselected  subfamily  yields  a 
significantly  large  c-j,  the  system  fails. 

Appl  ication  of  Zadeh '  s  Theory  of  Approxima'te  Reason! ng. 

Zadeh  has  developed  the  following  reasoning  pattern; 

X  is  A' 

if  X  is  Ai ,  then  Y  is  . . .Rj 
if  X  "s  Ap,  then  Y  is  Bp...Rp 
Y  is  B' 

where  A-j ,  A',  B-j ,  B' ,  are  fuzzy  sets  on  the  universes  of  discourse  U, 
V,  U',  V  respectively.  A^ ,  A,-'  qualify  an  attribute  of  X,  B^,  B' 
qualify  an  attribute  of  Y.  The  membership  function  of  B'  is  calcu¬ 
lated  by 

Mg  I  (V)  =  sup  min  <  M/\(u) , 

max  (-iin(l,  I-Ma.(u)  +Mg.{v))),  u  C  U,  v  e  V. 
i*l  ,n 
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4.4  Clusterinq 


Suppose  S  is  a  set  of  n  objects  oi,02,...On  .  Important 
are  functions  f  that  assign  to  every  subset  of  S  a  number  representing 
the  '^homogeneity"  or  "compactness"  of  the  subset.  f  is  0  for  sets 
with  0  or  1  elements,  and  positive  otherwise.  F  is  the  class  of  such 
functions.  A  primitive  k-clustering  function  is  any  member  of  F  that 
satisfies  the  following  additional  property. 

A^:  fn  Si,  S2CS,  f(Si  U  $2)  <  max  {f(Si),  f(S2)} 

wherever  |  Si  n  S2  |  ^  k. 

The  class  of  all  primitive  k-clustering  functions  is  denoted  by  F)., 
and  obviously,  for  1,  F|^  C  Fk+l-  F/henever  k^  n-1 ,  no  further 
restrictions  are  imposed  by  assuring  A|^  holds;  i.e.,  Fr,.-]  =  F. 

Although  properly  A;,  is  of  major  interest  for  the  initial  discussion, 
a  stronger  orooerty  will  be  necessary  later.  Consequently,  as  a  way 
of  introduction  and  to  provide  an  explicit  comparison  to  A(^,  we  will 
call  any  member  of  F  a  k-clustering  function  if  it  satisfies  F|^. 

Fk:  fn  Si,S2  C  f(Si  U  $2)  =  max  {f(Si) ,f ($2)} 

whenever  |  n  $2  j  ^  k. 

Property  A|^  defines  a  restriction  on  the  compactness  of  a  set  in  terms 
of  the  compactness  of  its  subsets.  Aj^  as  a  matter  of  fact  relates 
directly  to  the  property  introduced  by  Jordine  and  Gibson  as  well  as 
to  several  improtant  graph-theoretical  concepts  relevant  to  the 
clustering  task. 

Primitive  k-clustering  function: 
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c  2  R 

P{f,e)  the  sets  of  subsets  of  S  such  that 
Sic  P(f,f)  iff  F{Si)  <  f 

Prop:  If  f  eP|<,  then  for  any  value  of  c  ,  the  distinct  ele¬ 
ments  of  (f,  e)  overlap  at  most  k-1  objects.  [Note: 

Pmax’  (t,  f  )  =  those  elements  of  P(f,  C )  which  are  at  composition  level 
c  .] 


Let  Si,S2  e  Pmax^^»  where  Si  /  $2  and  assume  that  Si  and 
$2  overlap  more  then  k-1  elements.  Then  j  Si  n  S2  j  2.  since 

A|(  holds  with  both  f{Si)  ;<  e  and  f(S2)  ,  we  know  f(Si  U  $2)  £  c  » 

consequently,  Si  U  S2  c  P(ti(  c  )).  By  construction,  however 
$1  c  $1  U  S2  and  $2  t:  Si  U  $2  where  both  inclusions  are  proper,  and 
since  Si  and  S2  are  maximal  in  P(f,€)  we  have  obtained  a 
contradiction.  By  varying  c  we  obtain  a  hierarchy  of  sets  of 
subsets:  For  foF,  and  e  _>  e',  each  element  in  Pmax(^>  ^ 

subset  of  at  least  one  element  in  P^^x  (t,  e). 

A  hierarchy  of  sets  of  subsets  is  defined  by  f  as  e  varies 
from  0  to  +  oc  .  The  collection  Pmax('*'»®)  contains  only  the  single- 
element  subsets,  and  for  €  sufficiently  large,  Pmax^i"*  ^  )  contains 
only  S.  In  a  fixed  value  of  f,  the  subsets  develop  less  then  k  ele¬ 
ments  whenever  fz  Fj^;  and  thus  any  function  that  satisfies  \  may  be 
used  to  generate  a  subset  hierarchy  with  the  stated  overlap  property. 
Clearly  for  k  =  1  a  partition  hierarchy  is  obtained,  and  the 
constructed  sequence  of  subsets  is  actually  a  sequence  of  partitions. 

REMARK:  The  problem  of  hierarchical  clustering  can  be 
characterized  by  the  construction  of  a  hierarchy  of  sets  of  subsets; 
furthermore  from  my  point  of  view,  such  a  construction  would  be  effec- 
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tuated  through  a  function  foF,  or  if  overlap  is  desired,  through 
f  cFk- 


4.5  Denons 


These  are  procedures  which  are  activated  and  executed  by  the 
successive  appearance  of  certain  assertions  in  the  image  descriptions 
or  current  conceptual  database.  An  essential  feature  of  demons  is 
that  the  descriptions  are  continually  condensed  by  the  abstraction 
process:  descriptions  grow  in  depth  rather  than  in  length. 


JVDE 

RFL 

set  of  cO:iC 

1 

Betv/een  the  orientation  and 
trajectory  or  axis  of  an 
object. 

Backward,  Foreward, 

Sideways,  Around,  Over, 
Clockwise,  Counter-clock¬ 
wise. 

2 

Between  the  trajectory  of  an 
object  and  fixed  world 
di rect'ons. 

Down,  Up,  North,  South, 

East,  West. 

3 

Changir.g  between  objects. 

Across,  Against,  Along, 

Apart,  Around,  Away,  Away- 
froin.  Behind,  By  From,  In, 
Into. 

- 1 

Off,  Out-off,  On,  Onto, 

Over,  Through,  Together. 

4 

Indicative  of  source  and 
target . 

Away-from,  i n-the-di recti on- 
of,  in,  out,  toward. 

5 

Between  the  path  of  an  object 
and  other  (moving)  objects. 

After,  Ahead-of,  Along, 

Apart,  Together,  With 

6 

Between  an  event  and  previous 
event . 

Back  and  Forth,  To-and-Fran , 
L'p-and-Down,  Back,  Through. 
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4.6  Senantic  Nets 


Computer  programs  which  exhibit  knowlege  of  the  real  world 
when  interacting  with  their  users  must  include  powerful  mechanisms  to 
represent  that  knowledge.  The  greater  our  demands  are  for  a  program 
to  make  subtle  distinctions,  to  model  its  own  and  other’s 
understanding,  and  to  incorporate  new  knowledge  from  its  past 
interactions,  the  greater  are  the  demands  on  knowledge 
representations. 


DATA  TYPE:  The  dominant  data  type  of  successful  symbol 
merip'jlation  programs  has  been  the  expression  -  a  tree  of 
subexpressions  with  no  back  pointers.  Lisp  lists  are  such 
expressions,  as  are  production  rules  and  predicate-calcul us  (veil 
formes  formulas.  For  more  sophisticated  representations,  we  usually 
(a)  use  more  complex  data  structures  than  the  tree,  (b)  maintain  uni¬ 
que  structures  (c)  define  a  semantics  to  supplement  the  criteria  of 
well-'ormedness .  These  three  techniques  are  the  hallmark  of  semantic 
networks  (Sli).  A  typical  semantic  network  consists  of  uniquely  repre¬ 
sented  nodes  joined  by  arbitrary  links.  This  is  too  general  to  be  of 
any  use  to  the  system  builders.  Much  more  restrictive  conventions  are 
necessary  to  constrain  the  semantics  of  semantic  networks,  to  make 
the'  use  more  systematic,  more  meaningful.  We  need  to  think  of  SN 
with  rare  structure  as  to  allow  a  well  understood  semantics.  If  we 
can  manage  to  inherit  the  well  understood  semantics  of  first  order 
log-ic.  We  are  in  a  good  position  to  make  use  of  the  beneficial 
features  O'’'  that  logic.  This  opens  up  the  possibility  of  fast  proof- 
prccedure  implementation,  for  example. 

fpe  networks  we  shall  deal  with  are  acyclic  interconnections 
O'^  ■■''ctts,  cutouts  and  gates  by  means  of  wires.  A  network  with  n 
’■'’tut:  a^'d  u'  outputs  computes  m  Boolean  function  of  n  arguments. 
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bi(xi...,Xn)  =  zi 


^iTif  ^1  >  •  •  •  >  )  “  ^iTi 

The  gates  cf  a  network  are  the  copies  of  the  jobs  in  a  finite  basis. 
With  each  element  in  the  basis  we  associate  a  number  called  its  cost 
and  with  each  network  n  we  associate  a  number  L(n)  called  its  cost, 
which  is  the  sun  of  the  cost  of  the  gates  it  contains.  Let  b  be  a 
function  in  3'^.  L(b)  is  the  minimun  of  L{B)  over  all  networks  that 
co"'pute  b. 


SEYAN'IIC  INFGE’-'ATION  THAT  CAM  BE  USED  IN  SN; 


TYPE 

SUB-PASTS 

VISIBILITY 

DETERMINE  FROM  THE  IMAGE  SEQUENCE 

MOBILITY 

LCCATION 

OP.IENTATION 

SITE 

The  events  are  also  nodes  in  the  semantic  networks. 

II  Nodes  in  Description  node 

II  Nodes  in  Category  node 

II  !;odes  in  Function  node 

Each  object  is  potentially  the  Agent  in  an  event  node,  or 
object.  A  secu9''ce  of  event  nodes  *or~'s  a  history  of  movement  of  an 
object;  only  the  latest  node  in  the  sequence  is  active. 
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DEFINITION: 


SUBJECT:  An  object  which  is  exhibiting  movement. 
^.7  Boolean  Algebras 


A  Boolean  Algebra  is  a  structure  <(B,V^*,0b,1  ^  consisting 
of  a  set  8,  tv/o  binary  operations,  V>Aand  one  unary  operation  *  on  B, 
and  two  designated  elements  Og,  Ig  of  B  satisfying  the  following 
conditions:  for  any  x,y,z  b, 


xVy  =  yVx 
xVy  =  X 
(xVy)Ay  =  y 

(xVy)Az  =  (xAz)V(yAz) 
xVx*  =  Tg 


xAy  =  yAx 
xAx  =  X 
(x'Ay)Vy  =  y 

(xAy)Vz  =  (xVz)A(yVz) 

xAx*  =  Og 


0b/1b 

We  shall  write,  for  the  convenience  of  the  notation.  0  for 
Og  and  1  for  Ig,  and  B  for  the  underlying  set  of  the  Boolean  objects. 

A  binary  relation  on  B  is  defined  by 

X  <_  y  \  xAy  =  X 
or  eauivalently  xVy  =  y. 

The  relation^  is  a  partial  ordering  in  B,  called  the 
natural  partial  ordering.  0,  1  or  the  least  and  the  largest  element: 
xVy  the  S'joremum,  and  xAy  is  the  infimum,  of  {x,y}. 


I 


« 


} 
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A  boolean  algebra  B  is  iscnorphic  to  the  algebra  of  all 
closed-and-cpen  subsets  of  a  suitable  topological  space. 

A  non-er^pty  subset  of  B  is  called  a  subal gebra  of  B  if  it  is 
closed  under  the  operations  V.A  ,*  in  B. 

A  ho";onorDhi sn  of  one  Boolean  algebra  B  into  another  B'  is  a 
map  h:  3^-B'  such  that  for  all  x,y£B,  h(xAy)  =  h(x)Ah(y), 
h(xVy)  =  h(x)Vh(y)  and  h(x*)  =  h(x)*.  h  must  be  order-preserving, 
i  .e. ,  X  _<  y  — ^  h(x)  £  h(y)  for  any  x,y  c  B. 

A"  automorphi s"  of  3  is  a  one-to-one  homomorphism  o'f^  3  onto 
itself.  The  collection  all  autor-orphisms  of  B  forms  a  group  under 
function  composition:  this  group  is  called  the  group  of  automorphisms 
of  S. 

A  rj 1  ter  in  a  Boolean  algebra  B  is  a  non-empty  subset  Fq  of 
3  such  that 

(1)  X  c  F,  x<y  t  B  0  F 

(2)  X,  y  c  F^  xAy  c  F 

(3)  0  t  F. 

A  filter  F  v/iich  satisfies,  for  any  x  B; 

(A)  X  G  F  or  x*  e  F 
is  an  ultra-filter. 

The  language  of  set  tneory  is  a  first-order  language  L  with 
equality  V'.fi-ch  also  includes  a  bina’-y  predicate  symbol  g 


("rer.bership") .  The  variables  of  the  language,  range  over 

sets.  We  also  have  classes .  the  term  {x:  ^(x)}  means  "the  class  of 
all  X  such  that  <-3(x)".  V.'e  assume  that  classes  satisfy  Church's  schema 

Vy"ye  (x;  (^(x)  }  <5=>c(y)} 


- . 5  Boolean  functions:  Complexity  of  Computing  a  Function  with 
a  Network. 

Let  B  =  {0,1},  Vihere  0  is  "false,"  and  1  stands  for  "true." 
E^'  's  the  set  c~  lists  of  length  n  over  8.  The  elements  of  ere 
called  points.  A  Boolean  function  of  n  arguments  is  a  function  •f'ron 
on  3 


Let  US  denote  vrith  the  set  of  all  such  functions.  Dp  is  the  number 
O'  rcints  inj^^  and  ^(n)  is  the  number  of  functions  inj^'^ 


1 00  cnf n)  =  Dr 


the  fun 


:he  information  content  of  a  function  in__^’^  in  the  sense  that 
cticns  can  be  assigned  binary  codewords  of  length  Dp. 

'we  note  the  complexity  of  computing  an  arbitrary  function  in 
n  a  network.  Following  Shannon,  Luponov  showed  that 


w'-.e'e  A  is  a  cn-stant  that  depends  in  a  known  way  on  the  definition  of 
the  "netv.'O-'k"  adopted. 
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This  framework  is  equivalent  to 


=  P  ^  u/log  log  dA 
log  Dn  y  log  Op  / 

or,  obviously,  to 


=  P  log  <^(n)  log  log  log  <P(n) 

log  log  t?(n)  log  log  (n) 

where  U( — )  deontes  a  factor  of  the  form  expO( — ). 

A. 9  Frames 


A  basic  aim  of  man  living  in  the  world  is  to  "make  sense  of 
it,"  to  understand  where  he  is,  to  oerceive  the  situation  in  which  one 
happens  to  be,  to  interpret  it,  to  make  decisions  about  what  he  needs 
to  do.  Thus,  whenever  one  encounte’-s  a  new  situation,  he  must  be  able 
to  select  'rcn  "emory  a  remembered  framework  and  adopt  it  to  fit 
reality  by  changing  a  -^ew  details. 

’•'insky  proposes  the  concent  of  frame  as  a  basic  data  struc¬ 
ture  for  representing  knowledge  about  real-world  situations.  This 
hypothesis  is  that  one  represents  in  memory  a  number  of  stereotyped 
situations,  which  are  adapted  to  the  real,  actual  situations.  Each 
frame  has  attached  to  it  some  information  about  its  use  and  about  what 
can  be  expected  next  or  vjhat  to  do  if  the  expectations  are  not 
confirmed. 


Roughly  we  can  think  of  a  frame  as  a  set  of  nodes  and 
relations,  that  form  a  hierarchical  structure.  The  top  level  is  fixed 
and  contains  in-'^ormation  which  is  al--/ays  done  about  the  supposed 
situation.  '!'he  lov/er  levels  have  slots  (terminals)  which  must  be 
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filled  vrith  data  specific  to  the  real  situation.  Usually  the  slots 
are  specific  to  the  conditions  its  assignments  must  meet.  The  simple 
conditions  are  markers  like  the  requirement  for  being  a  person,  or 
female,  etc;  sometimes  the  assignments  themselves  are  simple  frames. 

A  collection  of  related  frames  constitutes  a  frame  system. 

In  a  •^rane  system  the  different  frames  represent  different  viewpoints 
of  the  same  situation  or  object.  Several  frames  may  share  the  same 
terminals  which  corresponds  to  the  fact  that  different  views  have  the 
sane  “eatures  perceived  i n  di fferent  views. 

The  decision  v.+iether  a  proposed  frame  is  suitable  is  made  by 
a  matching  process  controlled  by  one's  current  goals  and  by  infor- 
rat'cn  attached  to  the  frame.  Thus,  to  apply  a  frame,  one  has  to  go 
tr.rnjgh  the  following  steps: 

(1)  Partial  information.  Based  on  the  partial  evidence  or 
expectation,  a  frame  is  evoked. 

(2)  Current  goal.  A  list  of  current  goals  is  used  to 
decide  which  terminals  and  conditions  must  be  made  to 
natch  reality. 

(3)  Value  assignment.  The  terminals  that  cannot  retain 
their  default  information  need  to  have  new  values 
assigned  based  on  current  information. 

(-)  Transfer  of  control .  If  a  transformation  should 

happen,  then  the  initial  frame  would  transfer  control 
to  the  appropriate  other  frame  of  the  Frame- System. 
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i.lO  ?ros::ectus 


These  are  the  knowledge-representation  franeworks  that  seem 
to  us  to  be  potentially  useful  in  dealing  with  the  various  subclasses 
of  image-deri ved  information  that  might  become  relevant  to  DVS. 
Budgetary  considerations  prevented  a  thorough  comparison  and  eva¬ 
luation  O'  the  franeworks,  but  further  work  could  focus  on  carrying 
out  such  an  evaluation,  with  prioritization  decisions  made  as  to  their 
actual  incorporation  into  O'/S. 
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